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ABSTRACT 

Background: Although there is a lack of robust evidence from prospective cohort studies that supporting using 
3D ultrasound, it becomes widely used in the clinical practice of obstetrics. This review aimed At evaluating the 
evidence assessing the accuracy of 3D ultrasound, in the detection of cleft lip and palate in different populations 
at different trimesters. Methods: In July 2017, we conducted a systematic search of the databases (MEDLINE, 
EMBASE and Science Direct databases) as demonstrated in table 1. The titles and abstracts of the detected 
articles were screened to exclude irrelevantly and duplicated, in addition to articles of case reports and reviews. 
Finally, articles were finally included in this review and subjected to data extraction and qualitative data 
analysis. Results: The detection rates of cleft lip + alveolar bone cleft by 3D ultrasound imaging were found 
very high by many of the included studies. A range of 85%-100% detection rate of cleft lip only and cleft lip 
with cleft alveolus was reported by many studies. The detection rate of cleft palate with or without cleft lip 
varied between 50%-100%. This review revealed a detection rate of cleft lip and palate in low-risk populations 
ranged between 80-100%, while in high-risk populations the detection rate varied widely between 50% -100%. 
Conclusion: Although there is a wealth of evidence demonstrated the high accuracy of 3D imaging in the 
detection of cleft lip and palate, the available studies had a poor methodology with a high risk of bias in their 


findings. 
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INTRODUCTION 

The prenatal screening of congenital anomalies 
becomes a major research area in obstetrics. 
Ultrasound has been used as an important tool for 
prenatal detection of congenital anomalies including 
facial clefting ”. Facial clefts resulted from the failed 
fusion of yaw arch maxillofacial and nasal processes 
in the embryogenesis stage. The cleft lip plus or 
minus cleft palate are the most common facial clefts, 
which could occur as an isolated anomaly or 
associated with other global anomalies and 
syndromes ®. Cleft lip and palate incidence have 
reported reaching 2.19/ 1000 live births in the central 
province of Saudi Arabia, which is a higher incidence 
when compared to other countries such the UK where 
incidence rate was 182/1000 live births ®®. 

When using ultrasound, the detection rate of 
these clefts differed greatly according to the skills of 
the operator and the design of the study. It ranges 
from as low as 13% in a prospective study conducted 
by Stoll et al. © to as high as 90% in a retrospective 
study conducted by Benacerraf et al. “ Proper 
prenatal screening associated with early detection of 
facial clefts, especially in a low-risk population, can 
improve the management plan. Recently, the three- 
dimensional (3D) ultrasound imaging techniques 


Received: 30 / 7 /2017 
Accepted: 9 / 8/2017 


have introduced to the prenatal screening methods 


The benefits of using 3D ultrasound imaging include 
the provision of depth and volume, which explore 
more details than those available in two-dimensional 
(2D) ultrasound imaging ® There is a current belief 
that 3D ultrasound is a time-saving technique that can 
play an important role the future. However, it is not 
obvious what is the clinical significance of the 
additional data provided by 3D ultrasound imaging. 
Although there is a lack of robust evidence from 
prospective cohort studies that supporting using 3D 
ultrasound, it becomes widely used in the clinical 
practice of obstetrics ” The main problem occurs 
when using 3D ultrasound is the deviation from the 
initial plane, which can reduce the quality of the 
images. In addition to the problem of acoustic 
shadowing, that may also occur in 2D ultrasound ®. 
Recently, it becomes possible to update the 3D image 
at a rate of 24/second which leads to living view of 
the 3D volumes or what is known as 4D ultrasound 


This review aimed at evaluating the evidence 
assessing the accuracy of 3D ultrasound, in the 
detection of cleft lip and palate in different 
populations at different trimesters. 


2308 


DOI: 10.12816/0041534 


The Accuracy of Three-Dimensional Ultrasound Imaging... 


METHODS 

In July 2017, we conducted a systematic search 
of the databases (MEDLINE, EMBASE and Science 
Direct databases) as demonstrated in table 1. The title 
and abstract of the detected articles were screened to 
exclude irrelevantly and duplicated, in addition to 
articles of case reports and reviews. The full texts 
were retrieved for 23 articles and furthermore, 9 
articles were excluded from review because of 
inconsistent outcomes or unclear objectives. Since the 
number of articles aimed to assess the accuracy of 3D 
ultrasound imaging was small, no strict inclusion 
criteria were applied in this review. Only publications 
before 1990 were excluded since the ultrasound 
techniques before 1990 were incomparable with the 
recent techniques. Fourteen articles were finally 
included in this review and subjected to data 
extraction (table 2. The data were extracted for the 
outcomes such as study design, sample size, 
calibration methods, gestational age, detection rates 
for cleft lip and palates by 3D and 2D ultrasound 
imaging. This information was subjected to in-depth 
analysis and the risk of bias was assessed to evaluate 
the accuracy of 3D ultrasound imaging. The study 
was done after approval of the ethical board of King 
Abdulaziz University and written informed consent 
were obtained from study participants. 


RESULTS 

Fourteen studies were included in this review, in 
which 10 of them were prospective cohort studies “" 
au) 3 were retrospective studies (21:23); and one was 
mixed of prospective and retrospective approaches 
CD The samples of fetuses were selected either from 
high-risk populations as in 11 studies “1? 9715 17% 2% 
or from low-risk populations as in 3 studies “” 1679, 

The gestational ages of fetuses included in these 
studies were different, where some studies included 
the fetuses only in the second trimester “> '* 19 

Table (1): Summary of search results 


However, the majority of the studies included fetuses 
in the second and third trimester as in “2 8715 1 192 

All the studies mainly aimed to detect the 
accuracy of diagnosis made by 3D ultrasound 
imaging, however, 5 studies compared the accuracy 
of 3D ultrasound imaging to that of 2D imaging “> 1 
16, 20, 21) Tn regard to the main outcomes of this 
review, the detection rates of cleft lip + alveolar bone 
cleft were found very high by many of the studies 
included in this review. About 100% detection rate of 
cleft lip reported by “* '® 1 Slightly fewer 
detection rates of 95% and 85% were reported for 
cleft lip only and cleft lip with cleft alveolus 
respectively “* Moreover, the detection rates of 
palatal clefts were widely different across the 
included studies. Some studies reported 100% 
detection rate of cleft palates “* '*! while it was 
90% for cleft lip and palate detected by Sommerlad 
et al. "> Johnson et al., ®” found a detection rate of 
86% for cleft lip and palate, while a detection rate of 
78% for primary palate cleft found by Martinez-Ten 
and his colleagues in 2012 ?®, and the detection rate 
for isolated cleft palate was found 50% by Gindes et 
al. ” The comparisons of the accuracy of 3D 
ultrasound and 2D ultrasound were conducted by 5 
studies “* 14 16, 2, 2) All of them found the much 
higher accuracy of 3D ultrasound when compared to 
2D ultrasound, except Kurjak et al. “° who found 
the slightly higher sensitivity of 2D ultrasound but 
lower specificity than 3D technique. 

The calibration of the ultrasound scan 
images was reported by 8 of included studies, 
however, it was not conducted in a proper way “” '* 
16, 18-20, 22,24) Only one examiner reviewed the imaging 
findings “> ™ while tow reviewers examine the 
ultrasound images “> 1% 16 18, 2d and three reviewers 
in °. No study reported kappa statistics to 
demonstrate the agreement percentage between 
recruited reviewers. 





Search Engine Search Terms 


Limits activated Papers 





PubMed 


OR lip OR palate) 


(three-dimensional OR 3dimensional OR 3D) 
AND (ultrasound OR screening OR sonography) |years, English language 
AND (prenatal OR fetal OR fetus) AND (cleft 


All fields searched, All 148 





Science Direct 


(three-dimensional ultrasound OR 3-dimensional 
ultrasound OR 3D ultrasound OR screening OR 
sonography) ) AND (cleft OR lip OR palate) 


Titles, abstracts, keywords 237 
searched, All years, Medicine 
and Dentistry, English language 




















Titles and Abstracts examined 385 

Total Papers excluded 362 
Full texts retrieved 23 

Papers included in the review 14 
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Table (2): Summary of findings of Sensitivity (detection rate) in 3D ultrasound 













































































Reference Study Sample size Calibration tection of |Gestationa Sensitivity (detection rate) in 3D ultrasound 
design l Age All Cleft cleft lip with | cleft lip and | cleft lip with 
(weeks) | clefts lip only cleft cleft palatine] cleft alveolus 
alveolus he, without and palatine 
cleft alveolus bone 
Johnson Prospectiv | 31 fetuses of |One examiner | Location (15-35) Not- The Not-reported |Not-reported | (86%) of 22 cleft 
et al. e study high-risk view either 2D {ff cleft only {mean 24.8  bported location palates were 
population or 3D weeks 100% detected or 
accurate suspected 
Bäumler et al. |Prospectiv | 81 cases \of The same Location 23-29 771/19 15/15 3/5 (60%) No cases $9 (100%) 
a) e study high-risk examiners f cleft only | weeks (97%) (100%) 
population view either 2D 
or 3D 
Xu HX IRetrospecti | 4 fetuses of Not reported | diagnosis | Mean age 2/4 Not- Not-reported |Not-reported |-reported 
et al. ©” ve study high-risk was 29.7 (50%) reported 
population weeks 
range, 16- 
42) 
Sommerlad et |Prospectiv |124 cases of | Not reported | diagnosis 20-34 Not- 116/122 87/103 Cleft secondary hard palate 
al." e study high-risk weeks reported (95%), (84.5%), 61/68 (89.7%), 
population 
Martinez-Ten 7 cases 3D datasets |Diagnosis_ |the median Not- Not- Not-reported |the primary palate was detected 
et al. °” (3 cases included were ind quality |age was 12 [reported reported in 7/9 cases (77.8%). 
retrospectively and 4 examined of image |range, 11— Clefts of the secondary palate 
prospectively) of high risk [separately by 13) were confirmed in 6/6 (100%) 
hree operators. 
Mittermayer |Prospectiv | 18 of high- examination | diagnosis 15/15 (100%) of cases 12/12 (100%) who were 
etal. “® e study isk population | performed by (mean were correctly detected affected with a cleft primary 
two of the 23.64 4.5 Palate detected 
authors weeks). 
Faure et al. ©” |prospectiv |87 fetuses of a | Tow observer | diagnosis 21-25 Not- Not- Not-reported | The frequency of detection of 
e study low-risk With significant weeks of __|reported reported the uvula and of the 
population difference gestation velum for each observer varied 
between them between 80% and 90% 
Tonni Prospectiv | 1856 of low- |Reviewed by 2 | diagnosis | 18 to 23 the detection rate of 100% 
et al. "% e study pulation praphers ks of cleft lip and palate 
Zajicek A 49 (43 Examination |diagnosis |Mean age |2/2 (Tow fetuses with soft and hard palate cleft were identified correctly) 
et al. "® rospective |r routine ormed by two 1.2 weeks 100% 
study In, and 6 operators 
ere of the 
jopulation) 
Kurjak A 15 cases of Not reported | diagnosis |(12 — 40) 10/11 jot-reported |Not-reported |Not-reported | Not-reported 
et al. rospective | high-risk ks (91%) 
study population (with one 
ative) 
Ulm Prospectiv | 17 fetus of Not reported | diagnosis | Mean 23 17/17 1/1 Not-reported |Not-reported 16/16 
et al. °” e study population 51 weeks) (100%) 
Gindes IRetrospecti | (57 cases- 7 2D and 3D diagnosis Mean Not- Not-reported (only palatal cleft evaluated in 
et al. ve study termination images =27 weeks fed lensitivity of detection of palatal 
= 50) of reviewed by -40 weeks) clefts were 71.4%, 
high-risk two The detection rate for isolated 
pregnancies experienced late is 50% (2/4 cases were 
examiners diagnosed) 
Rotten IRetrospecti 96 cases Not reported |Diagnosis |The mean 84/96 In eight cases (8.3%), the sonographic examination 
et al. © ve study Of low-risk y of cleft |was (88%) underestimated the severity of the cleft. 
lation 28.2+4.1 Conversely, sonography overestimated the severity of 
the cleft in four cases (4.2%). 
Campbell Prospectiv 8 cases Not reported Diagnosis | 20-31 6/8 jot-reported | Not-reported Not Not-reported 
et al." e study In high-risk weeks (75%) reported 
lation 
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Table (3): Summary of findings of Comparison to 2D (if available) 


Reference 


Johnson 
et al, ® 


Sommerlad 
etal. ®© 


Martinez- 
Ten et al. ® 


Mittermayer 
et al, °% 


Faure et al. 
(12) 


Tonni et al. 
(16) 


Zajicek et al. 
(18) 


Kurjak et al. 
(13) 


Study design 


Prospective 
study 


Prospective 
study 


Retrospective 
study 


Prospective 
study 


Sample size 


31 fetuses of 
high-risk 
population 


81 cases \of 
high-risk 
population 


4 fetuses of 
high-risk 
population 


124 cases of 
high-risk 
population 


7 cases 


(3 cases included 
retrospectively and 4 
prospectively) of high risk 


Prospective 
study 


prospective 
study 


Prospective 
study 


A 
prospective 
study 


A 
prospective 
study 


18 of high- 
risk 
population 


87 fetuses of 
a low-risk 
population 


1856 of low- 
risk 
population 
49 (43 
attended for 
routine 
examination, 
and 6 
ere of the 
high-risk 
population) 


15 cases of 
high-risk 
population 


Calibration 


One 
examiner 
review either 
2D or 3D 
The same 
examiners 
review either 
2D or 3D 


Not reported 


Not reported 


3D datasets 
were 
examined 
separately by 
three 
operators. 


examination 


performed by 
two of the 
authors 
Tow 
observer with 
significant 
difference 
between 
them 
Reviewed by 
2 
sonographers 


Examinations 
were 
performed by 
two trained 
operators 


Not reported 


Detection 
of 


Location 
of cleft 
only 
Location 


of cleft 
only 


diagnosis 


diagnosis 


Diagnosis 
and 
quality of 
image 


diagnosis 
diagnosis 


diagnosis 


diagnosis 


diagnosis 
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Gestational 
Age 


(weeks) 


(15-35) 
(mean 24.8 


weeks 


Mean age 
was 29.7 
weeks 
(range, 16— 


the median 


age was 12 
(range, 11- 
13) 


21-25 
weeks of 


gestation 


18 to 23 
weeks 


Mean age 
was 14.6 + 
1.2 weeks 


(12 — 40) 
weeks 


Comparison to 2D (if available) 


Cleft lip 
only 


Location 
was 


cleft lip 
and 
cleft 
palatine 
bone, 
without 
cleft 
alveolus 
accurate 


Not- Not- 
reported | reported 
in (93%) detected 
Not- Not- Not- Not- 
reported | reported | reported | reported 
Not- Not- Not- 
reported | reported | reported 


Not- Not- Not- Not- 
reported | reported | reported | reported 


Not- Not- 
reported reported 


7/12 (58%) of 
13 cleft lips (80%) | “*°°S with a cleft 
were correctly 


primary 
detected 


cleft lip 
with 
cleft 

alveolus 
and 

palatine 
bone 


cleft lip 
with 
cleft 

alveolus 


All clefts 


(41%) 


Not- were 


reported 


Not- 
reported 


Not- 


0130) reported 


Not- 
reported 


Not- 
reported 


Not- 
reported 


Not- 
reported 


Not- 


r ted 
reporte Palate correctly 


identified 


Not- Not- Not- Not- 
reported | reported | reported | reported 


They found that 3D US was more accurate than the 2D 
US for defining the severity of the lesions. 


Not- Not- 
reported | reported 


11-Nov 
-100% 
(with 4 
false 
positives) 


Not- 
reported 


Not- 
reported 


Not- 
reported 


Not- 
reported 


Not- 
reported 


Not- 
reported 


Not- 
reported 


Not- 
reported 





Prospective 1T Ase Mer Not- Not- Not- Not- Not- 


high-risk Not reported | diagnosis (range 18- 
study population 31 weeks) reported | reported | reported | reported | reported 


(57 cases- 7 2D and 3D 
termination images 
= 50) of reviewed by 
Gindes et al. | Retrospective high-risk two di : Not- Not- Not- Not- Not- 
(22) study 1Agnosis | _97 weeks reported | reported | reported | reported | reported 
experienced (range of 
examiners 12—40 
weeks) 


; . The mean + 
96 cases Diagnosis SD was 


and Not- Not- Not- Not- Not- 
severity 28.2 +4.1 reported | reported | reported | reported | reported 
of cleft 


Ulm et al. °” 


Mean 


pregnancies 


Rotten et al. | Retrospective 
23) study 


Of low-risk | Not reported 
population 


8 
Campbell et Prospective pane Not- Not- Not- Not- Not- 


al. 9 study ace Not reported. | Diagnosis reported | reported | reported | reported | reported 





Figure (1): Flow diagram of the screening, identification and inclusion steps of the systematic review 


Relevant articles 
identified (n = 385) 


Excluded Articles by screening the title and 
abstract (n = 362): 


irrelevant articles (n = 353) 
case reports (n = 3) 
reviews (n = 6) 






Articles for which full 
text retrieved (n = 23) 
Articles excluded (n = 9): 


e articles did not assessed the main outcome 
accuracy) (n = 5) 


e article with inconsistent objective (n = 4) 


Articles included in the 
review (n = 14) 
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DISCUSSION 
The findings of this review demonstrated 
the evidence of a high accuracy of 3D ultrasound 
imaging in the detection of cleft lip and palate. In 
regard to the cleft lip with or without cleft of 
alveolar bone, the detection rate was high (between 
85%-100%). In another hand, the detection rate of 
cleft palate with or without cleft lip varied between 
50%-100%. This review found a detection rate of 
cleft lip and palate in low-risk populations ranged 
between 80-100%, which is much higher than the 
accuracy of 2D ultrasound reported by a systematic 
review of Maarse et al. °°) He found a range of 9%- 
50% detection rate of 2D ultrasound in low-risk 
populations. These findings revealed the presence of 
evidence supporting the accuracy of 3D ultrasound 
in detection cleft lip and palate among low-risk 
populations. In high-risk populations, Maarse et al. 
°°) found a range of 60%-100% detection rate of 
cleft lip and palate, which is similar to that found in 
the current review. Thus, the 3D ultrasound imaging 
can be very helpful in detection of cleft lip and 
palate in low-risk populations. 
Studies that compared 3D technique to 2D have not 
divided the cases into two intervention groups with 
randomization, instead they did screening by 2D 
then they scanned fetuses by 3D which yield net 
accuracy of both techniques rather than the 
accuracy of each technique separately. The correct 
methodology was to use two groups of cases (for 
2D and 3D), randomly selected and to compare the 
findings of ultrasonic imaging with the outcomes at 
birth to calculate true positive, true negative, false 
positive, and false negative. After that, the 
calculations of sensitivity, specificity, positive and 
negative predictive values would be possible. 

AS no proper sample size calculation was 
done by any of the included studies sample sizes 
used in the included studies varied widely. In 
general, studies conducted among low-risk 
population recruited larger numbers of cases than 
those conducted among high-risk populations, 
particularly in the study of Tonni et al. “®, where 
1856 women were recruited. The risk of bias 
among included studies was considerably high 
especially in other retrospective studies ?"”” 

The gestational age was different in the 
included studies that could affect the detection rate 
of the cleft lip and palate since there is a significant 
difficulty in the diagnosis of the cleft lip and palate 
before week 20 of the pregnancy. Many authors of 


included studies have not correctly identified the 
accurate dominators for calculation of detection 
rate. Some used number of all live births as a 
dominator rather than using the actual number of 
newborns with lip and palate clefts. Other authors 
included stillbirths and deaths in the calculations, 
which yield invalid detection rates. Another cause 
for variation in the 3D accuracy was the 
inconsistent definition of the outcome, where some 
studies identified the detection rate of all facial 
clefts and some for the categories such as cleft lip 
only, cleft lip with cleft alveolus, cleft lip and 
palate, cleft soft palate only. 


CONCLUSION 
Although there is a wealth of evidence 

demonstrated the high accuracy of 3D imaging in 
the detection of cleft lip and palate, the available 
studies had the poor methodology with a high risk 
of bias in their findings. There is a great need for 
high-quality clinical trials to evaluate the accuracy 
of 3D ultrasound imaging in the detection of facial 
clefts. 
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